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Abstract 



We study here the dynamics (and stability) of Probabilistic Population Protocols, via the differential 
equations approach. We provide a quite general model and we show that it includes the model of Angluin 
et. al. Ql, in the case of very large populations. For the general model we give a sufficient condition for 
stability that can be checked in polynomial time. We also study two interesting subcases: (a) protocols 
whose specifications (in our terms) are configuration independent. We show that they are always stable 
f] , and that their eventual subpopulation percentages are actually a Markov Chain stationary distribution. 

-1 ■ (b) protocols that have dynamics resembling virus spread. We show that their dynamics are actually 

similar to the well-known Replicator Dynamics of Evolutionary Games. We also provide a sufficient 
condition for stability in this case. 

> 

O ' 1 Introduction 

In the near future, it is reasonable to expect that new types of systems will appear, designed or emerged, of 
massive scale, expansive and permeating their environment, of very heterogeneous nature, and operating in 
a constantly changing networked environment. Such systems are expected to operate even beyond the com- 
plete understanding and control of their designers, developers, and users. Although they will be perpetually 
adapting to a constantly changing environment, they will have to meet their clearly-defined objectives and 
provide guarantees about certain aspects of their own behavior. 

We expect that most such systems will have the form of a very large society of networked artefacts. 
Each such artefact will be unimpressive: small, with limited sensing, signal processing, and communication 
capabilities, and usually of limited energy. Yet by cooperation, they will be organized in large societies 
to accomplish tasks that are difficult or beyond the capabilities of todays conventional centralized systems. 
These systems or societies should have particular ways to achieve an appropriate level of organization and 
integration. This organization should be achieved seamlessly and with appropriate levels of flexibility, in 
order to be able to achieve their global goals and objectives. 

Angluin et al. HJ |2l introduced the notion of a computation by a population protocol to model such 
distributed systems in which individual agents are extremely limited and can be represented as finite state 
machines. In their model, finite-state, and complex behavior of the system as a whole emerges from the 
rules governing pairwise interaction of the agents. The computation is carried out by a collection of agents, 
each of which receives a piece of the input. These agents move around and information can be exchanged 
between two agents whenever they come into contact with each other. The goal is to ensure that every agent 
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can eventually output the value that is to be computed (assuming a fairness condition on the sequence of 
interactions that occur). 

In HI they also proposed a natural probabilistic variation of the standard population protocol model, 
in which finite-state agents interact in pairs under the control of an adversary scheduler. In this valiant, 
interactions that occurs between pairs of agents are chosen uniformly at random. We call the protocols of [1 J 
by the term "Probabilistic Population Protocols" (PPP). In [3 ] they presented fast algorithms for performing 
computations in this variation and showed how to use the notion of a leader in order to efficiently compute 
semilinear predicates and in order to simulate efficiently LOGSPACE Turing Machines. [4] studied the 
acquisition and propagation of knowledge in the probabilistic model of random interactions between all 
paris in a population (conjugating automata). 

In this work we characterize the dynamics of population protocols by examining the rate of growth of 
the states of the agents as the protocol evolves. We imagine here a continuoum of agents. By the law of large 
numbers, one can model the undelrying aggregate stochastic process as a deterministic flow system. Our 
main proposal here is to exploit the powerful tools of continuous nonlinear dynamics in order to examine 
questions (such as stability) of such protocols. 

We first provide a very general model for population protocol continuous dynamics. This model (Switch- 
ing Population Protocols - SPP) includes the probabilistic population protocols (PPP) of [1] as a special 
case, when the population is infinite and the time is continuous. 

We show a sufficient condition for stability of SPP that can be checked in polynomial time. We also 
examine two subclasses of SPP: 

• The Markovian Population Protocols (MPP). In these protocols, their specifications are configura- 
tion independent. In this very practical case, we show that MPP are always stable and their unique 
population mix at stability is exacly the steady-state distribution of a Markov Chain. 

• The Linear Viral Protocols (LVP). They are probabilistic protocols motivated by the "random pairing" 
of HI- However, agents review their current state at a higher rate when they have weak "immunity". 
We view this as a general model for the dynamics of viruses spread in the population. We show that 
LVP are equivalent to the well-known "Replicator Dynamics" of Evolutionary Game Theory, and thus 
to the well-known Lofka-Volterra dynamics. We also give a sufficient condition for stability of LVP, 
based on Potentials. 

2 The General Model (Switching Probabilistic Protocols - SPP) 

The network is modeled as a complete graph G where vertices represent nodes and edges represent commu- 
nication links between nodes. We use the letter n to denote |V|, the number of nodes in the network. Each 
node is capable of executing an "agent" (or process) which consists of the following components: 

• K, a finite set of states. We use the letter k to denote \K\. 

• X, a nonempty subset of K, known as the inital states or start states. 

We consider a large population of n agents. Let q G K be a state of the agent and let n q the number of 
agents that are on the given state p. Then the total population size is n = J2i=i n i- The proportion of agents 
that are at state q is x q = ^-. We call x q the density of q. In the sequel q = qi, where i £ {1,2, ... , k}. 

A state assignment of a system is defined to be an assignment of a state to each agent in the system. 
A configuration C is a map from the population to states, giving the current state of every agent. The 
population state then, at time t, can be described via a vector x(t) = (xi(t), . . . , Xk(t)). Here Xi(t) = 2i, 
i = l...k. 



In the sequel we assume that n — ► oo. We are interested, thus, in the evolution of x(t) as time goes on. 
We use a different model (compared to [ 1 ]) for describing a protocol P. We imagine that all agents in the 
population are infinitely lived and that they interact forever. Each agent sticks to some state in K for some 
time interval, and now and then reviews her state. This depends on x(t) and may result to a change of state 
of the agent. Based on this concept, a switching population protocol consists of the following two basic 
elements (specifications): 

1 . A specification of the time rate at which agents in the population review their state. This rate may 
depend on the current, "local", performance of the agent's state and also on the configuration x(t). 

2. A specification of the switching probabilities of a reviewing agent. The probability that an agent, 
currently in state qi at a review time, will switch to state qj is in general a function pij (x(t)), where 
Pi (x) = (pn (x) , . . . ,pik (x)) is the resulting distribution over the set K of states in the protocol. 

In a large, finite, population n, we assume that the review times of an agent are the "birth times" of 
a Poisson process of rate Xi (x). At each such time, the agent i selects a new state according to pi (x). 
We assume that all such Poisson processes are independent. Then, the aggregate of review times in the 
sub-population of agents in state qi is itself a Poisson process of birth rate XjAj (x). As in the probabilistic 
model of [lj we assume that state switches are independent random variables accross agents. Then, the 
rate of the (aggregate) Poisson process of switches from state qi to state qj in the whole population is just 
Xi(i)\i(x(t))pij (x(t)). 

When n — > oo, we can model the aggregate stochastic processes as deterministic flows (see, e.g., (9) 
[TTIl ). The outflow from state qi is J2j^i x jXj (%)Pij (%)• Then, the rate of change of Xi(t) (i.e. -j| '- or 
Xi(t)) is just 



<} / 
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x jPji (x) Xj (x) ~ X{ (x) Xi (1) 



for i = 1, . . . ,k. 

We assume here that both Aj (a?) and p^ (x) are Lipschitz continuous functions in an open domain £ 
containing the simplex A where 



J K 

< [Xi, . . . , XfcJ : 2 j '• 
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By the theorem of Picard-Linderlof (see, e.g., [6] for a proof), Eq.[T]has a unique solution for any initial 
state x(0) in A and such a solution trajectory x(t) is continuous and never leaves A. 

2.1 SPP includes the probabilistic population protocols 

We now show that our model of Switching Probabilistic Protocols (SPP) is more general than the model 
of HI in the sense that it can be used to define the Probabilistic Population Protocols (PPP). We do this by 
showing the following: 

Theorem 1 The continuous time dynamics of PPP (when n — » oo) are a special case of the dynamics of 
SPP. 

Proof. According to [1 J, the discrete-time dynamics of a Probabilistic Population Protocol (PPP) are given 
by a finite set of rules, R of the form 

(p,q) ^ (p',q) 

where p, q,p', q' G K (K = {qi, . . . , q^}) together with a set A of n agents and an (irreflexive) relation 

E C Ax A. 



Intruitively, a (u, v) G E means that u, v are able to interact. HI assumes further that E consists of all 
ordered pairs of distinct elements from A. 

A population configuration in HI is a mapping C : A \— > K (K is the set of states). Let C and C be 
population configurations, and u, v be two distinct agents. [ 1] says that C can go to C" in one discrete step 
(denoted C h- > C) via an encounter e = (u, v) if 

(C(u),C(v))^(C'(u),C'(v)) 

is a rule in R. This means that the state C(u) of u switches to C'{u) and also C{v) switches to C'{v). 

The execution of the system is defined to be a sequence Co, Ci, C2, . . . of configurations (where Co is 
the initial configuration) such that for each i, Ci h-> C + i. An execution is fair if for any C and Cj, such 
that Cj 1— * Cj and Cj occurs infinitely often in the execution, Cj also occurs infinitely often in the execution. 

In the probabilistic version of the above, [1] further states that e (the ordered pair to interact) is chosen 
at random, independently and uniformly from all ordered pairs corresponding to edges e in A x A ([ 1 ] calls 
it the model of Conjugating Automata, inspired also by [4J). 

Let us now assume that n — > 00 and let Xi = lim n ,_ KX) ^ be the population fraction at state qi € K at a 
particular configuration C, at time t. Consider the rule p in R 

(q r ,q m ) •-> (<?;,9j) 

Without loss of generality we assume in the sequel that r ^ m and i ^ j in such rules p in i?. By the 
uniformity and randomness, the probability that such an e, that follows from rule p, is selected (as the 
encounter), is just x r (t)x m (t). Let Ai be the set of all (r, m) that are the left part of a rule p: 

{q r ,q m ) >-> (quqj) 
or (q r ,q m ) >-» (<?,,%) 

Let 5j be the set of (r, m) that are the left part of a rule p': 

{q r ,q m ) >-> (q r >,qm>) 

with r = i or m = i. Without loss of generality let r = i in //. By considering a small interval At and 
taking limits as At — ► 0, due to fairness we get Vz: 

Xi = ^2 x r (t)x m (t) - Xi(t) ^2 x m (t) (2) 

The above set of equations describe the continuous dynamics of PPP. 

Now, consider our SPP dynamics and Eq.Q] Set Aj (x) = J2 x m (t), with m ranging over all rules 



r 1 Hm' 



(q r ,q m ) ^ (q r >,q 

with r = i, and all rules 

(q m ,q r ) >-> (q r ',q m ') 

with r = i (i.e., over all rules in B. L ). 

Also, set p m i = p r i = 0, if r, m do not belong in any tuple of Ai. 
Finally set 

Pri = T - / t X m \t) 
r meC(r,i) 

where C(r, i) is the set of indices m in the second argument of the left part of rules in Ai (i.e. (qy, q m ) 
(q r >, q m i) with r' = i or m' = i). 



Then our system of Eq.[T](the SPP dynamics) becomes the system of Eq.[3](the PPP dynamics). Thus 
the PPP dynamics are a special case of the SPP dynamics in the continuous time setting. □ 

Here is an example of the reduction described above. Let the rules R in PPP be 

(91,^2) i-> (93,92) 
(93,9i) *-* (91,92) 
(92,93) i-» (92,91) 

This gives the continuous PPP dynamics: 
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and this results in our SPP dynamics, namely: 

x'i = xiAipn + X2A2P21 + X3A3P31 - X1A1 
x'2 = X1A1P12 + X2A2P22 + X3A3P32 - x 2 A 2 
x 3 = X1A1P13 + X2A2P23 + X3A3P33 - X3A3 

3 Stability of nonlinear dynamic systems: a sufficient condition for decid- 
ability. 

Let us consider a dynamic system 

x i = Ji \ x ) 1 % = 1) • • • , "1 

that is, in fact, more general than Eq. [TJ 

Definition 1 (Fixed Points) Let x* be a solution of the system {fi (x*) = 0, i = 1, . . . , k} which we call a 
fixed point of the system. 

By making a Taylor expansion around x* we obtain a linear approximation to the dynamics: 

xi = £ (x, - x*) |L (af) 



Setting £i=Xi — x* we get 

A = V; 

ax 



6 = E^(^ 



which is a Linear System with a fixed point at the origin, i.e., £ = L£ where the matrix L has constant 
components L^- = -g^ (x*). L is called the Jacobian Matrix. Then, by the theorem of 0] we have 

Corollary 2 If the fixed point x* is hyperbolic (i.e., all eigenvalues of L* have a non-zero real part) then 
the topology of the dynamics of the nonlinear system around x* is the same as the topology of a x* in the 
Linear system. 

In fact, let each eigenvalue of L be 4> = a + iu. 

Corollary 3 Let a / 0, \A/> eigenvalues of L. Then 

(a) If a < 0, V(/> then x(t) approaches the fixed point x* as t — > oo. 

(b) If there exists a </> with a > then x(t) diverges from the fixed point x* along the direction of the 
corresponding eigenvector. That is, the fixed point x* is unstable. 

Thus we get our main result of the system: 

Theorem 4 If all fixed points x* of our population dynamics of Eq. Q]are hyperbolic, then we can decide 
stability of the population protocol, around x* , in polynomial time in the description of the protocol. 

Corollary 5 If all fixed points of PPP are hyperbolic, then the stability of PPP can be decided in polyno- 
mial time. 

4 Switching Population Protocols with specifications independent of the con- 
figuration 

We now consider the special case of Eq. Q] where \ (x) = \. Vi and where pij (x) = pij (specifications 
independent of the configuration x(t)). Then the basic system of Eq. [T]of the dynamics of the population 
becomes: 

X\ = ^ X j^jPji ~ ^i X i i = l...k (3) 

We call such protocols by the term "Markovian Population Protocols" (MPP). 

Let qij = XiPij for all i,j, when i ^ j and when j = i let qa = Aj (pa — 1). Then Eq. |3]in fact becomes 

! = quXi{t) + ^2qkiXk(t) (4) 

Note that Y^ieK x i(t) = 1< But this is, in fact, the basic equation of the limiting-state probabilities of a 
Markov Chain of k states with q,^ being the (continuous time) rates of change (see, e.g., [8], pp. 53-55). 

When all \j, i ^ j are non zero then the Markov Chain of Eq.@]is irreducible and homogeneous. Then 
the limits lim^oo Xi(t) always exist and are independent of the initial state. The limiting distribution is 
given uniquely as the solution of the following equations: 

1jj x 3 + Yl QkjXk = 
Mi 

So, we get our second major result: 



Theorem 6 (Markovian Population Protocols - MPP) Let the specifications {\j,Pij} independent of the 
configuration x(t). Let also XjPij ^ 0, Vi, j where i ^ j. Then the Population Protocol is stable. It always 
has a limiting unique configuration {xi i = 1 . . . k} independent of the initial configuration x(0), which is 
exactly the steady-state distribution of an ergodic, homogeneous Markov Chain of k states. 

5 A special case of Random pairing population protocols 
(Linear Viral Protocols - LVP) 

Now, let us assume that all reviewing agents adopt the state of "the first man they meet in the street". This is 
clearly the case when the reviewing agent draws a pairing agent at random from the population (according 
to the uniform probability distribution across agents) and adopts the state of the so sampled agent. This 
is similar to the case of the protocols of [Tj where the rules are (qi,qk) >— ► (Qm,Qr) with r , m £ {h j}- 
Formally then 

Pij (x) = Xj \/i,j G K, \/x(t) 

Now Eq. @] becomes 

X{ — / ^ XjXiAjyXj AiyXJXi 

i.e. 

Xi = 1^2 XjXj(x) - Xi(x) ■ Xi (5) 

W / 

We now propose a "linear" model in order to capture the immunity that an agent has against other agents 
in the population. We postulate that agents immunity depend on their states. One can imagine immunity to 
be a measure of the degree of protection of agents when they interact. So, when an agent in state qi interacts 
with an agent in state qj we measure the immunity of the (qi , qj ) pair by an integer a^ and we require here 
that aij = &ji. It is then natural to assume that agents in state qi will wish to review their state more often 
when their immunity is low. In particular we assume here that any agent in state qi has a review rate \ (x) 
that is linearly decreasing in the average immunity of the agent in state qi. This is the simplest possible 
model, the formal definitions follow: 

Definition 2 (Immunity of a state) Let A = {a^} be a symmetric matrix of integers. The immunity of an 
agent in state qi is ti (x) = anX\ + . . . + a^x^. 

Definition 3 (Average immunity of a population protocol, in a particular configuration) Let Abe a sym- 
metric matrix of integers. The average immunity of the population, in configuration {x{\, is: t(x) = 

J2i£K x iti { x )- 

Definition 4 (Linear Viral Protocols - LVP) The Linear Viral Protocols are switching population proto- 
cols with review rates of agents 

Xi (x ) = 7 - 5U (x) 

where 7, 5 € K, 5 > and also j/5 > ti (x), \/x + A, VI 

Now Eq. [5] becomes 

Xi = 5(ti (x) - t(x))x,i (6) 

Note, now, that this equation is a constant rescaling of the popular "replicator dynamics" of Evolutionary 
Game Theory (see, e.g., [101 ). 



Definition 5 The general Lotka-Volterra equation for k types of a population is of the form 

k 



Xi — X{ | T{ -\- y 3{jXj 



i = l...k 



where Vi, aij are constant. 

By the equivalence of the Replicator Dynamics with the Lotka-Volterra systems we then get: 

Theorem 7 The dynamics of the linear viral protocols are equivalent to the Lotka-Volterra dynamics. 

We can then give an alternative sufficient condition for the (asymptotic) stability of the Linear Viral Proto- 
cols. 

Theorem 8 Let x* be a fixed point of Eq. [6j i.e., t,i (x) = t (x) is satisfied for x = x*. If J2i=i x *ti (x) > 
t (x) for any x in a region around x* , then x* is asymptotically stable. 

In order to prove our theorem, we first consider the relative entropy of x and x* as 



£(*) = -$>* In § 



i=l 



(V) 



Clearly E(x*) = 0. Then we need to prove the following claim: 

Claim 9 E{x) >E(x*),Vx 

Proof. From Jensen's inequality it folds: 

exp(/(x)) > /(expx) 
where exp() is the expectation, x a random variable and / a convex function. Thus Eq.|7]becomes 



/ k \ / k \ 

£(*)>-m(£z*|M>-lnK> 



lnl = 



D 



Proof. Based on Claim|9]we can prove Theorem[8]as follows: 



dE (x(t)) 
dt 



J^dE 



i=\ 



dx; 



(due to Eq. [6]) 



k 

= -J2Hk(x)-t(x))xt 

" k 

= -5 *£x*(U(x)-t(x)) 
< by assumption 

Thus, in a region around x*, ^| < 0. Then E is a (strict) Lyapounov function (see, e.g., Q, pp. 18-19) and 
thus x* is stable asymptotically. □ 



6 Conclusions 

The population protocol model of Angluin et. al. fH consists of a (large) population of finite-state agents 
that interact in pairs. Each interaction updates the state of both participants according to a transition function 
based on the pair of the participants' previous states. A natural probabilistic model, proposed in Q]], assumes 
each interaction to occur between a pair of agents chosen uniformly at random. We call the protocols of 
[1] by the term "Probabilistic Population Protocols" (PPP). [4] studied the acquisition and propagation of 
knowledge in the probabilistic model of random interactions between all paris in a population (conjugating 
automata). Curiously, the differential equation approach for such protocols was not proposed till now. 

We imagine here a continuoum of agents. By the law of large numbers, one can model the underly- 
ing aggregate stochastic process as a deterministic flow system. Our main proposal here is to exploit the 
powerful tools of continuous nonlinear dynamics in order to examine questions (such as stability) of such 
protocols. 

We have extended the class of (H by defining a general model of "Switching Population Protocols" 
(SPP). We then examined stability for this general model and two important subclasses. Our main point is 
that one can study stability and population dynamics of protocols, via nonlinear differential equations that 
describe quite accurately the (discrete) population protocol dynamics when the population is very large. The 
"differential equations" approach was indicated in the past for the analysis of evolution of algorithms with 
Random Inputs, by EUTH. Our approach provides a sufficient condition for stability of PPP of [1] that can 
be checked in polynomial time. It also gives a more general way to specify population protocols, that reveals 
interesting classes. 
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